More Projects




Evaluation of R Forwards Package Workshop

I recently co-taught a daylong course for a group of 30 women/gender nonbinary students about how to write R packages- we had a really good time! I analyzed our pre- and post- surveys in a notebook, to check how effective the day was for students.

Keywords: r, data visualization



Kiva Loan Data Analysis

  • GIS analysis of loans by country with attention to economic conditions in countries
  • Drilldown on some of the thematic areas of the loans
  • Data munging of the regional data provided
  • Exploring modeling potential- if repayment time can be predicted, or anomaly detection if labeling outcomes is not possible

Keywords: r, data visualization



Tutorial: Fun with Real Estate Data

This project is a kaggle kernel, in which I walked the reader through the process of cleaning and modeling the data from a real estate prices dataset, using linear modeling, random forests, and gradient boosting (xgboost). My most popular kernel to date! This one also produced respectable competition results, and was chosen for special recognition by the Kaggle admins. (I won a mug!)

Update: Read the interview I did regarding this project (and the other fabulous winners)! http://blog.kaggle.com/2017/03/29/predicting-house-prices-playground-competition-winning-kernels

Keywords: machine learning, data cleaning



Data for Democracy 2017 Hackathon

I led a team working on the Chicago Lobbying project, which produced some great output, including this visualization of lobbying and aldermen in Chicago. The project is continuing and building out new functionality. I personally cleaned some of the data underlying, but my biggest contribution was organizing, planning, and leadership. Additional results: https://data.world/lilianhj/chicago-lobbyists

Update: Check out a case study by the fine folks at data.world discussing the work that went in to this project: https://medium.com/@sharonbrener/dbf30aeee70b



Exploring Austin, Texas Crime

Among the public datasets available on Kaggle is this one, describing the crimes that have occurred in Austin, TX over a couple of years. This project cleans the data, does some exploratory analysis, and maps various kinds of crime by district

Key Skills: data cleaning, GIS


Interruptions at the First Presidential Debate

My first natural language processing/text mining! This was a lot of fun, because I watched the debate and then was able to examine how well my actual perceptions matched what the data told me.

Key Skills: NLP, data cleaning



Manufacturers and the Drugs They Make

This project is part of my work for Data for Democracy, a great loose association of data scientists working on projects for public benefit in their free time. This was my first Shiny app, and it’s always getting a few tweaks and improvements when I have time.

Key Skills: web coding, data visualization, Shiny



Medical No-Shows in a Brazilian Hospital

What features of patients help providers predict who is at risk of not showing up to appointments? This one provides insights that could be used by the actual hospital that is the source of the data that can be used to improve their patient care.

Key Skills: data cleaning, modeling, data visualization, machine learning



Dental Care in the ACA Marketplace

I think this is a good kernel, but it never got traction because the data was not glamorous and the results were not very cheerful. In short, the dental coverage from the ACA is seriously inadequate for population needs, unfortunately.

Key Skills: data cleaning, GIS



Tidy Text Mining in Facebook Posts

In this project, I used a provided dataset of facebook posts from a community group and analyzed a few details about the content- specifically, how sentiment and gender related to “likes” on the posts.

Key Skills: NLP, data cleaning, data visualization



kaggle | github | linkedin | youtube